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■ DERIVATION OF STUDIO CAMERA POSmON AND 
MOTION FR OM THE CAMERA TMAHir. 



; ■ ./.Field of tKe f wptioT^ 

. : -This mveiitioh relates to the derivation of infonnation regarding the position of a 
television camera from' muge datt acquired by the camera. 

background m the ^nvi.nfi».. 

In television prbdiidiion. it is often required to video live action in the studio and 
electronically superimpose the action on a background image. Tliis is usually done by 
shooting the action in from of a blue background and generating a 'key' fiom' the video 
signii tolfi^^ b^ and background: to the b^kground aiea^. 

the chosim badcground ii^ 

One liiniatibii tb thi^. technique is that the camera in the snidio camrot move, since this 
would generate motion of the foreground without commensurate background 
momnemj: : Ok » move is to use a robotic camera 

: inb&iiig tim alldw^i^^ ^ be executed, the saine camera 

"^d^wteir die background images are shoL However the need for pre- 
defined motion plaoK severe artistic limitations on the production'proc^. 

: ?:^ques are curremly under development that aim fo' be able to genaatt 
ele^,ricaU£fecl ^o{md images that can be changed as the caijiera" is moved so that 
jjg. appropriate, to the present camera position. TTius a means of measuring the 
glPqlitiO? of the camera in the studio is required. One way in which this can be done is 
to attach.sensors to tiie camera to determine its position and angle of view; however 
the use of such sensors is not always practical. 
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TlK problem being addre^ is a method to Oerive the position and motion^of the 
camera using only the video signal from the camera. Thus it can be used on an 
unmodified camera without special sensors. 

Description of Prior An 

The derivation of the position and motion of a camera by analysis of iis.image signal is 
a task often referred to as passive navigation; there are many examples of approaches 
to this problem in the literamre. the more pertinent of which are as follows: 

1. Brandt et al. 1990. 

Recursive motion estimation based on a model of the camera dynamics. 

2. Brandt. A., Karmann. K.. Lanser, S. 

Signal Processing V: Tlieories and Applications (Ed. Torres. L. et al.). Elsevir pp 
959-962. 1990. 

3. Buxton et al 1985 

Machine perception of visual motion. 

Buxton, B.F.. Buxton, H., Murray. D.W.. Williams. N,S. 

GEC Jfdumal of Research. Vol. 3 No. 3, pp. 145-161. 

4. -Netttvali-and Robbins 1979 
Motion<ompensated television coding: Pan 1. 
Netravali. A.N.. Robbins, J.D. 

Bell System Technical Journal Vol. 58, No. 3. Mar. 1979. pp. 631-670. 

5. Thomas 1987 

Television motion measurement for DATV and other applications. 
Thomas, G.A. 

BBC Research Department Report No. 1987/11. 
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6. Uompri et al. 1992 . , 

Electronic image stabilisation system for video cameras and VCRs. 

Uomori, K.» Morimura, A., Ishii, J. 

SMPTE Journal, Vol. 101 No. 2. pp. 66-75. Feb. 1992. 

7. Wu and Kittel 1990 

y^j^:^.-^ *,^^^' ^- A differential method for simultaneous estimation of 

rotation, change of scale and translation. Signal Processing: Image Communication 2, 
Elsevier, 1990. pp. 69-80. 

For example, if a number of feanire points can be identified in the image and their 
motion tracked from frame to frame, it is possible to calculate the motion of the 
caniera relative to these points by solving a number of non-linear simultaneous 
equations [Buxton et al. 1985]. The tracking of feature points is often achieved by 
measuring the optical flow (motion) field of the image. This can be done in a number 
of : vv^ys. for example by using an algorithm based on measurements of the spatio- 
temporal luminance gradient of the image [Netiaveli and Robbins 1979]. 

A similar method is to use Kahnan filtering techniques to estimate the camera motion 
parameter from the optical flow field and depth information Prandt et al; 1990]. 

However, in order to obtain reliable (relatively noise-&ee) information relating to the 
: -motfimof the camera, it is necessaiy to have a good number of fe^ poihts visible at 
all times, and for these to be distributed in qace in an appropriate manner. For 
exanq)le. if all points are at a relatively large distance from the camera, the effea of a 
pan (rotation of the camera about the vertical axis) wiU appear very similar to 
that of a horizontal translsttipn at right angles to the direction of view. Points at a 
range of depth are thus required to distinguish reliably between tiiese types of motion. 



Simpler algorithms exist tiiat allow a sub-set of camera motion parameters to be 
determined, while pUcing less constraints on the scene content. For exainple. 




■-r- measurement. of hnriyhmai w'**^-^;;;^! iT-ii.-^^^^ . - • 



:mmirei5^t.ofh6riM 
panning and tilting can be measured relatively stepI/fdrippiiiSibM^^^ as the 
steadying of images in hand-held cameras [Uomori et al; 1992]. - 

Summarv of the Invpnf^ni^ . 

In order to derive aU required camera parameters (thitt sj^tili cboitimates. pan and 
tilt angles and degree of zoom) from analysis of the canidia Siages. a lirge nuiber of 
points in the image would have to be idenfified and track^. Cobsideiation of the 
operational constraints in a TV smdio suggested that providing an appropriate nmnber ~ 
of well-distributed reference points in the image w6uld bi: iiiipHi«ickl: mikeri "would 
have to be placed throughout the scene at a range of diff.^" depths in such a way that 
at a significant mmiber were always visible, regardless of the' position of the camera or 
actors. 

We have appreciated that, measurements of imagje fansMm md sralb change arc 
rebtively easy to make; ftom these measurements it is <^ to calculate either 

1 • pan. tilt and zoom under the assumption that the tamera is mounted on a 

fixed tripod: the scale change is a direct indication of the aiiionnt by which tfab degree 
of camera zoom has changed; and the horizontal and verti^ traiBlation mdicate the 
change in pan and tih angles; or 

2. horizontal and vertical movcmem imder the assun^itioi that die camera 

:.is mounted in such a way that it can move in three dimensions (but cannot pan or tilt) 
and is looking in a directioii normal to a planar: backgrouharW 'sbaie change indicates 
the disoncc the camera has moved along the optical axis and^the 'image -t^ 
;i|n^tes how &r the camera has moved notmal- to' this -aSusi S^'ly * ■ -^<^- 




This approach does not require special mariccrs or feaniite ■points ia-tiif linage; merely 
-sufficient detail to allow simple estimation of global motion pmineters. Thus' it 
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should be able to work with a wide range of piofire material. All that is requin^d is a 
measurement of the initial focal length (or angle subtended by the field of view) and 
the initial position and angle of view of the camera. 

The invention is defmed by the independent claims to which reference should be made. 
Preferred feamres are set out in the dependent claims. 

The approach described may be extended to more general situations (giving more 
freedom on the type of camera motion allowed) if other information such as image 
depth could be derived [Brandt et al.' 1990]. Additional infonnation fiom some 
sensors on the camera (for example to measure the degree of zoom) may allow more 

flexibility. 



In order to aUow, the translation and scale change of the image to be measured, tbere 
must be sufficient detail pi«em in the background of the image. Qnieapi^^'is 
Jjsual ^itsed upon the use of a blue screen background, to allow rj ^ri^H^ 
generate by. analysing. the RGB vah^ ^ the vid«) signal; -Clearly, a plain blue " 
screen camiot be used if cam^amotioamformatio^^ 
sinceitcomainsnod egil^^rir^irb ^^ 

markmgs of some sort, but is sfflTofTsuhable form to allb;^ a key signal to b^ 

generated . . ■. . : ■ ■ ■ - ■•■.•'iTr.:;;,:- ■ • •. „.., ' 

Oner fohffof background that is being considered is,^^^^^>iq^ of 
similar shades of blue, each closely resembling the blue ^StouTu^S^resent. TTiis 
should allow present keying techniques to be d«d; while" providing sufficient detail to 
optical flow measu,enienr . s ro htL ffiade. Such measurements could be made on a 
signal derived from an appropriate weiglit^ sdin^bf RGB ^ Values designed to accenkte 
the differences between the shades bfi bl^i^^^•-^ii^'>■ " ' ^-^ ' :L;j-i ..-D 

The key signal may be used to remo ve foreground bbjects from the image nrinr ,» 
JUgtion^ timation process. Thus the hiotion'bf feregroimd obiei^ts-arn^f ^nft;,: .y 
calculationT^ — — ^ ""^ 
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estimator system embodying the invention; 

^ illustrates the.ielationship of measurement points in current and reference 

^ ' -images; \ . 

Figure 3 is a schematic view showing the displacement of a given measurement point 
from a reference image to the currait image; and 

Figure 4 shows a checkeriward background. 
Description nf MnH^ 

M ''^S^'^'^'^^ global translation and scalechange must satisfy 

^*^. 7 '^L \ ^ «^ it 

must nih in real-tinM ' y^" ^ : 

erxors;^ manifest thcmo^^ 
background: 

3 . Measur^CTi errors should not accumulate to a significant extent as the 

mov« fur^ 

. . GlQbal Motion Parameter betennina^^ ^ ^^j...^ . nv,. i : i:.;. o . 

An example of one typejof algorittan that could be ;used is one basaijon a recm^ve- 
spatio-ieraiwral gradierif t^^ 

1979]. This kind of algorithm is known to be computationally efficient and to be able 
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to measure sinall displacements to a high accuracy. Other algorithms based on block 
matching described in reference 6 fUomori et al. 1992] or phase correlation described 
in reference 5 [Thomas 1987] may also be suitable. 

The algorithm may be used to estimate the mbtion on a sample-by-sample basis 
between each new camera image and a stored Reference image. The reference image is 
initia lly that v iewed by the camera at the start of the shobti ng,:jv^4he^^cajTO is in a^ 
dmo^josition; Before each measuremem/the^ expected translation and scale ch ange, 
IS Br ed i cted fr om previous measurements and the reference image is subject to a 
translation and scale change by this estimated amount; Thus the motion estimation 
process need only measure the difference between the actual and predicted motio n. 

The motion vector field produced is analyzed to determine the horizontal and vertical 
displacement and scale change. This can be done by selecting a number of points in 
the- veaor field likely to' have accurate vectois (for exanpfc in regions having both 
high image detail and uniform vectors). - Th^ can be d&imined by 

examinmg the difference betweai selected veabrs as a function of the spatial 
separation of the points. The translation -can then be determined from the average 
values of the measured vectors after discounting the effect of the scale change. The 
measured values are added to the estimated vahies to yield the accumulated 
displacement and scale change for the present camera image. 

MOre"s<^hisdcated methods of analysing the vector field could be added 'in future, for 
example in conjunction with means for determining the depth of given imag e points, to 
extend the-flexibility of the system. 

rAs the accumulated translation and scale change get la^efl the translated reference 
image^ll -begm to provide a jxwr apprbxiriiatibri to the ' current onieri image. ' For^ 
example, if the camera is panning to the right, picture material bh the right of the 
current image will not be present in the reference image and so no motion estimate can 



: ^ Problenf. once; the accumulated values 

exceed :a given thr^hoid the refereiKe image is replaced by the present camera image. 
Each time this happens however, measurement errors will accumulate. 

' thepr^^ carried out on images jfliat have been spadaUy^filtered and 

. the amp.pt of computation required. with no significant 

, ^^'^^m ?''^- .fiittring process also softens the nnage; this is 

known tp improve the accuracy and reliabUity of gradient-type motion estimators; .. 
Further computational savings can be achieved by carrying put the, processing between 
alternate fields rather than for every field; this will reduce the accuracy with which 
'^P'**..^>5^B?S .^;.«« but this is unlikely to^ be a problem since: most, . 

movements of smdio cameras tend to be smooth. 

*P ™Plomeiit the most computaiionally-mtensive parts of the processmg has 
to provide, information to.- aid the^ specification and, .: 
design,of tte:ha^ Ihe benchmarks showed that ;theprt)cess o^ 

filtering and down-sampling the incoming images is. likely to use over half of the total 
compuutipn titne^^ 

Embodhnent 2: DiT«-t F^rigiatinn of ninh M Motion Par»n„.r^ 

An^tomtive and preferred method of determining global translation and scale change 
tp-lteriye them- direcUx: from the video signal. A method of doing this Is described 
in refere^ 7 by. [Wu aiid Kitttl 1990]. We have extended this method to work using 
a stored reference image and to use the predicted mouoa values as a starring point. 
Furthermore, the technique is applied only at a sub-set of pixels in the image, that we 
^Y?.^_^5? JSP?^SSF P°m ^5l°!??.'-:.to ral"ce-.th«5,computationaLl^ in the 
P"!?-?*^?!;?!^!??*?"^^^ is matrixed tOifbim a singlfecomponenri 
signii-imd;^»^y jow:pass fUtcred pripr.to proccssing.-,,As described' prfeviously?.r. 
only areas identified by a key signal as background are considered. - . . 
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The method is applied by consid^ a number .of measurement pbfiits in each - 
incoming image and the corresponding points in' the reference image, displaced 
according to the predicted translation and scale change. These predicted values may be 
calculated, for example, by linear extrapolation of the measurements made in the 
preceding two images: The measi^ be arranged as a^regular; array; 

as shown in Figure 2. A more sophisticated approach would be to concentrate 
measurement points in areas , of high ii^^ gradient, to .improve the accuracy when 
a limited number of points are used. We have found that 500-1000 measurement, 
points distributed uniformly yields good results. Points falling in the foreground areas 
(as Mcated by t^e ^ey signal) are discarded, since, it is the motion of the backgioui^ " 
that is to be determined. 



At each measurement point, luminance gradients are calculated as shown in 
^i^^ c ^..^ taking the difference : 

calculated for the corresponding point in the reference image, offsei.by; the predicted 
motion. Sub-pixel interpolation may be employed when calculating these values. TTie 
temporal Immnance gradie^^ is also calculated; again sub-pixel- interpolation may be 
used in the reference image. An equation is formed relating the measured gradients to 
the motion values as follows:. 

^re (approxiinately) related to displacement and scale changes by the 

equaSon- 

fixX + g,y + (2-l).(g,x + g,y) = g, 



where 



are the horizontal and vertical luminance gradients, averaged between the two images; 
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g<V. are horizontal and vertical lununance.feradients in current image; 
gr„ gr, are horizontal and vertical luminance gradients in reference image; and 
.. ;-vgis the tenq» 

• . X and Y are the displacements between current and reference image and Z is the scale 
change (over and above those predicted). 

-An equation is foimed for each measurement point and a least-squares solution is 
calculated to obtain values for X, Y, and Z. 

Derivation of the equation may be found in reference 7 [Wu and Kittel 1990] (this 
reference inchidcs the effea of image rotatibn; we have omitted rotation since it is of 
little relevance here as studio cameras tend to be mounted such that they bannot ibtate 
about the optjc^axis). 



The set of snnultaneous linear equations derived in this way (one for each 
measmemetit point) is solved using a standard least-squares solution method to yield 
estimates of the difference between the predicted and the actual translation and scale 
change. The calculated translation values are then added to the predicted values to 
. yieldjh^ estimated nanslation between the reference image and die current image. 

Similarly, the calculated and predicted scale changes are multiplied together to yield 
the estimated scale change. The estimated values thus-calculated are then used to 
derive a piediction for the translation and scale change of the following image. 

As described earUer. the reference image is updated when'the ca^'has moved 
sufficiently far away from its mitial position. This automatic rcfrohing process may 
be triggered, for example, when the area of overlap between the incoming and 
reference image goes below a given direshold. When is^ing the ai^ of overlap, 
the key signal needs to be taken account of, since for example an actor who obscured 
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the left half of the background in" the Wereiice _ii2age Mghif« 
the right half, leaving no visible back^ound in conmion between incoming and 
reference images. One way. of measuring, the dcgree'cf overlap ii to comtt the number 
of mcMurmeiit points that areu^ 

the incoming ami refeirare jin^e):"^"inim tiM^nunA^ of 

measurement points, that were usable when the reference image was first used to 
obtain admeasure of ffie iisable -image ai^^ yS a ff^Sn of ii^'m^uii^ 
obtainable with that reference image; Irthe 'init^-im^^ 

reference image was itself below a given toeslraidj thii would indicate that mcKtofjhe 
image was taken up with foregidimd rathor' thk^ b^lrbti^^ warning m^ge 
should be prodticed/ - ' - " '-' ~ ' ■ ' ■ ■- - \- 

It can also be advantageous to refresh the reference image if the measured scale change 
exceeds a given range (eg. if the camera zooms in a long way). Although in this 
situation the riumbCT oT iisabl*:' meisxitthdit)^^ of 

the stored teference'imkge-Mii brooiae 'm^leqktt 'S^Sw aSaiiatt motion ' 
■ estimation.''" ■ ■ ■ ■■■ ■ ■■.■:.■=•.■.•■■•.■•■ ■■■ . - 

When the reference iniage is updated, it can be r^iaiiKirin mmoiy for fiimre use. 
together with details of iS^ aiwumulated '<iq>iaf^ebtmid scale 
change. i:Whehik deciabn is^mite^'tliSt'^^^ 

appropmte, the stored^finages can'be'^eajnibed to'seewiKthCT a^ k 
suitabK t)f the Wr -T^^ ^ 
those explained above. For example, if tte'a^^iS to ihe left and then back to 

- its staiting positioA; the initial refereince toi^e"h^^ ' 

-approach4s'tKisFfesiti6n!*^ 
atthieeia^bfthe-se^eiideWii^^^ 

Referring back to Figure 1. appara:nis W'pi&iig-iacfi wo motion estimation 
methods btd practice ii' shown; "A'eli^^iof^^sT^iaw'fe'frii the 
background 12 which, as described previously, may te'^iia'mi^' to'^i^lSij^ ' 
shown in Figure 4. the background cloth shown in Figure 4 shows a two-tone 
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arrangement of squares. ■ Squares 30 -of one toiit:!ltt aiTai^^^^M^SiM^§ 
the other tone. Shapes other than squares may be used and it is possible ti) use more 
than two different tones. Moreove r^ tones may differ in botKlhueia^ Drighm ess or 
Jiuather hue or bright^ a, n ^ considered prefer?bl^fbi?;ihe: brightness to 

constat as variation? ip brightness might show in theVmal imge-V *^^^ 

Aliou^tte colour bhie ^s the.aiost common for the bactelpth pther colours, for 
example, green or orange are sometimes used when appropriate. , The technique 
desCTibed is not peculiar to apy particular background colour but requiies. a sUght . 
Action in hue and/or bnghtows between a immber of difraent,arcas,.Qf the 
background, and that the areas adjacent to a given area have a brightness, and/or hue 
different from that of the given area. ITus contrast enables motion estimation from the 
bacl^round to be performed. 

siiigle glour si^ and appU<»l to a spatial low-pass mtei^K«,l,4).,,The low-pass : 
output is appUed to an image store 16 which holds the refaence hnage data and whose 
output is transformed at 18 by applying the predicted motion for die image. Tbc 
motion adjusted reference image data is applied, together witi, the low-pass fUtercd 
image to a unit 20 which meuures die net motion m backgipund.akeas between an, 
'"'^^^.^'f !^.^ana^^stOIed. rcfe|^ at inpatR^ The unit 2Q 
'^fS^ °f *^.T'?5"i1f!??^°? »Jgorit»ms de«:ribed,,, Jte net motion 
nie^nfedfeni is perfor^ mito die control of a key signal K derived by "a key 
'geieratt)r22fromtteW^ 
foreiion^-jwrtop^ofA 

^"^^ '^^.!^^f^!^:!P^^ '^'^.^ ensuring fliat tiie output from 

camera has moved sufficiemly away from its initial position a refresh signal 24 is sent 
from the net motion measj«mem^^m^ 

refresh si^ 24 a fresh i^^^ iii th?^image 5;pre and iised.as.thetasis for. 
fiimre net motion measurements. 



.■■-'^-•=i-T'rr*r^...-i^ ^ . 
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nie output fh)m the ii« nk,dim -g;^ derive an indication of 

current camera position and orieniation as disciissed previously. 

'«f«rence imagw as weU as. dK 

nie technique described can also be applied to image signals showing arbitrary picnne' " 
f^^SmmJ^;^mPm4 d««nibed earlier. If objects are moving in 
the scene, these, can bc^^g^^by virtue of their, motion nuher than by using a 
chroma-key signal. Tht segmentation could be peifoimed. for example, by 
'*^'?^.m^?^«^:l»^. for ,which:the temporal tominance gradient (after 
compensating tte^predict^ bad^ above a certain threshold 

Moie sophisticated techniques for detecting motion relative to the predicted background 



motion can also be used 



^ "^^"^^^^.^P^. t^^hniques desaibed may be implemented either by 
special purpose digital signal processing equipment, by software in a computer or by a 
combination of these methods.:,* will also be clear that the technique can be applied 
e^uaUy weU to any teleyisiw .. 
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CLAIMS ^ 

1 • A method of measuring the translation and scale change in a sequence of 

video images, comprising storing the first imige in tte^s^gi^Sft^'i^^ 
stored image by a prediction of the translatioii iKl^^^l^^ 
miage in the sequence with the transformed fnst.image. and deriving fern the 
comparison measuremems of translation aiid scale tiiaiige; th^^A^ g^r^lacing 
the first reference image with a new iiicomiiig imag^ Wn^th^' dverliliitivieii ' 
reference and incoming images falls below a given proportion 

2- ^ ™<^«l'«ccording to claim l.. Tvhbn;ii^^W 

the image are used in the measurement of transladon and'?^^^^ " 

3- A method according to claim 2. Where? thTd^^iis&i'ib^ 4^te 
foreground and background is derived using ctrOina-ki^'^t^iiSi^f'' 

4- A method according to claim 2. where the signal W'^'si^ 
foreground and backgromHi portions of th^ fanages is derived using motion detection 
methods to identify objects moving with a different motion fiom that predicted for the 
background. 
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_ ^_ A method according to any preceding claim, wfittein-eich- image is a 
single-canponem signal derived from a camera viewing a scene corltainiiig a 
background of near-miiform colour, the background being divided into a phirality of 
areas each having a hue and/or brightness different to the hue and/or brightness of 
adjacent areas to allow the generation of a key signal by chroma-key techniques, and 
wherein the single-component signal is formed from a tim^-component camera signal 
so to accenmate as differences in hue and/or brigtoness of individual areas pf the 
background to enable motion estimation. 

6. A method for measuring the translation and scale change in a sequence 

of video images derived by a camera, comprising storing ti,e first image of the 
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a single compoiiint signal derived by a camera 
viewing a scene containing a background of near-uniform colour, the background being 
divided into a plurality of areas each having a hue and/or brightness different to the 
hiie-apd/or brightness -of adjkent areas to allow generation of a key signal by chioma- 

being formed from the camera signal so as 
to accemuate differences ia tnie^^^ brightness of individual areas of the background 
to enable motion estimatibn; transforming the stored image by a prediction of the 
translation and scale change, comparing a further image in the sequence with the 
transformed first image and deriving from die comparison measuremehis of translation 
and scale change. 



7. A method according to claim 5 or 6. wherein the background is divided 
into a plurality of areas, each area having one of two hues and/or brightnesses. 

8. Am&od according to claim 5. 6 or 7, wherein the areas of the 
background ai^square^^ 

^' A metib^-^rding to any preceding claim , where the translation and 

scale change are predi(^,by the computation of a number of simultaneous equations 
^^^9^J?hicli relate the. tt^u^ scale change to spatial and tenqwral gradients 
^ ref^^^ solved to yield a least-squares sohition 

for. motion parametersi^^^^^^ 

i.i . : - A method according to any preceding claim, comprising selecting a 
nmpber of measurement points in the reference image ^for motion estimation, and 
replacing the reference image with a new incoming image when the number of 
:r-?15¥?rai^^^p^^ in areas of background visible in both the reference 

."^^^^^^ below a given proportion bfthe total number 

,.of measuremertt pomts. 
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reference image is if the scale change between an hacoming image and the reference 



image exceeds a given factor. 

^ -V: A domprising s^atiaUy pre- 

'irr^^igt^ringvt^^^ 

13. A method according to any preceding claim, wherein m which the 
V , measuiemem points He in a regular array in 

14, A method according to any of claims 1 to 2, wherein the measurement 
; - points are chosen to lie at points of high spatial gradient. 



15. A ™fit^od acconling to any preceding claim, conq>rising storn^ 

reference images for later use. : 



16. Apparanis for measuring tiie translation and scale change in a sequence 

of video.images, comprising means (10) for acquiring the sequence and images, 
storage means (16) for storing the first image in the sequence; means (18) for 

:.;.tta5?fonn^ the stored image by a prediction of the translation and scale change. 

v^jmeans ttttJtransfbtmodjto image in the 

jeq^ deriving Aercfrom mcasuremems of translation aikl aile'change. 

" chara^te^ by means (24) for replacing the first reference image with a new 
incoming image when the overlap between reference and incoming images Ms below 
a given proportion. . : ; ; ; :: 

^'^•>- : rAppa^nis according to claiiri l6..whOT 
i i9P!y-0ii background areas of tiie.images,;cOTq^ 
foreground and background portions of the images using motion teclmiqu£s to identify 
objects moving with a different modon from that predicted for the background. 
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18. .V • .. • Apparatus according to claim 16,- wherein the derivation means operates 
only on the background areas of the images, comprising a key generator for generating 
a chroma-key to separate foregroimd and back^und. 

19. r Apparatus according to any of claims 16 to 19. comprising means (12. 
10, 14) for generating a single-component signal from a camera viewing a scene 

. .contaming;a back)^uiid of near-uniJofei c61our.^the background being divided into a 
plurality^of areas leach having a taic aiKi/or bnglitDess" different to the hue and/or 
brightness of adjacent areas;to allow thd gtiieritibn of a key signal by chroma-key 
techniques. fflKl^Where in the sirfeleK»nii)6fiem^a^^ is formed fiom a three- 
^ ; component tainera-sigiial so as^ td^ accratiM diffog^ in hue aid/w bri^taie^ bf 
individual areas of the bacl«rtamd% enable liiotibn estimation. 

20.;- .r v: r. r=i«iM)paratus. for iheasining the^ i„ ^ sequence 

of vid(» images derived by a cahaav comptish^ meahs (16) for storing the first 
image of the sequence, the image comprismg a smgle componcm signal derived by a 
cainera.;vieviiig;a scene'CTntaihm^ of hw-umfotm colour, the 

background betng-divided into a phiialify'of ireas iiach having a hue and/or brightness 
different to the hue and/or brightness of adjacent areas to allow generation of a key 
signal by chioma-key techniques, the single-conqionent signal being formed from the 
camera' si^ so as to acoemuate differences in hue and/or brightness of individual 
..,f?^ ^f" background to enable motion estimation; means (18) for transforming the 
' Stored image by a prediction of the translation and scale change, aiid me^ (20) for 

comparing a further image in the sequence with the transformed first image and for 
deriving from the comparison measurements of translation and scale change. 

21. . Apparams according to claim 19 or 20, wherein the background (12) is 

" P!"^ °f (30.32) each ar«a having one or two hues and/or 

brightnesses. 

22. Apparatus according to claim 19. 20 or 21 . wherehi the areas of the 

background are square. 
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^ Predioing ^le translation and scale change byjiu^cm^mx^^^ of 
simultaneous ie^tions each of which relate the tranijatira ai^^^ 

5£3i:leaa-squares^»lu^^ 




means (20) comprise! means for selecting a nmnber of mcasuicmem. points in the 
reference linage for motion estimation and for replacing the reference image witha 
new iiK^oming image when the nmnber of measurement points, which lie in areas of 
^^f^^^:^ ^ ^ reference image and a given incoming. image falls below 
a given proportion of the total mmiber of measurement points. ^ 



u; ; . ;; according to any of claims 16 to 24;; coniprising a spatial 

26. ^PP^^ according to any of claims; 16.to ,25, conqmsing a fMier 

^rage means (16) for storing replaced reference images for fiituic i^^^^ 
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